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ABSTRACT 

Context. HR4796 is a young, early A-type star harbouring a well structured debris disk, shaped as a ring with sharp inner edges. The 
inner edge might be shaped by a yet unseen planet inside the ring; the outer one is not well understood. The star forms together with 
the M-type star HR4796B, a binary system, with a projected separation of ^ 560 AU. 

Aims. Our aim is to explore the surroundings of HR4796A and B, both in terms of extended or point- like structures. 
Methods. Adaptive optics images at L'-band were obtained with NaCo in Angular Differential Mode and with Sparse Aperture 
Masking (SAM). We analyse the data as well as the artefacts that can be produced by ADI reduction on an extended structure 
with a shape similar to that of HR4796A dust ring. We determine constraints on the presence of companions using SAM and ADI 
on HR4796A, and ADI on HR4796B. We also performed dynamical simulations of a disk of planetesimals and dust produced by 
collisions, perturbed by a planet located close to the disk outer edge. 

Results. The disk ring around HR4796A is well resolved. We highlight the potential effects of ADI reduction of the observed disk 
shape and surface brightness distribution, and side-to-side asymmetries. We produce 2D maps of planet detection limits. No planet is 
detected around the star, with masses as low as 3.5 Mjup at 0.5" (58 AU) and less than 3 Mjup in the 0.8-1" range along the semi-major 
axis. We exclude massive brown dwarfs at separations as close as 60 mas (4.5 AU) from the star thanks to SAM data. The detection 
limits obtained allow us to exclude a possible close companion to HR4796A as the origin of the offset of the ring center with respect 
to the star; they also allow to put interesting constraints on the (mass, separation) of any planet possibly responsible for the inner disk 
steep edge. Using detailed dynamical simulations, we show that a giant planet orbiting outside the ring could sharpen the disk outer 
edge and reproduce the STIS images published by Schneider et al. (2009). Finally, no planets are detected around HR4796B with 
limits well below 1 Mj^p at 0.5" (35 AU). 

Key words, stars: early-type - stars: planetary systems - stars: individual (HR4796) 



1. Introduction 

Understanding planetary systems formation and evolution has 
become one of the biggest challenges of astronomy, since 
the imagin g of a debri s disk around JS Pictoris in the 80 's 
jSmith and Terrile 1984b and the discovery of the first exo- 
planet around the solar-like star 51 Pegasi during the 90's 
( [Mayor and Queloz 1995| ). Today, about 25 debris disks have 
been imaged at optical, infrared, or submillimetric wave- 
lengths (http://astro.berkeley.edu/kalas/disksite). Debris disks 
trace stages of system evolution where solid bodies with sizes 
significantly larger than the primordial dust size (larger than me- 
ters or km sized) are present to account for through collisions, 
the presence of short lived dust. They are thought to be privi- 
leged places to search for planets. This is particularly true for 
those showing peculiar structures (e.g. rings with sharp edges) 
or asymmetries, spirals even though other physical effects not in- 
volvi ng planets could also lead to the formation of similar struc- 
tures. [^SeucEiandArtymowicz 2001 for instance showed that 
relatively small amounts (typ. 1-a few Earth masses) of gas can 
shape the dust disk through gas-dust interactions into rings (see 



below). It is remarkable however that all the stars around which 
relatively close (separations less than 120 AU) planets have been 
imaged are surrounded by debris disks: a < 3-Mjup planetary 
companion was detected in the outskirts of Fomalhaut's debris 
disk (119 AU from the star; Kalas et al. 2008), four planetary 
companions of 7-10 Mjup were imaged at 15, 24, 38 and 68 
AU (projected separations) from HR 8799 C Marois et al. 20081 
IMarois et aL2 010). Using VLT/NaCo L'-band saturated im- 
ages, we detected a 9^3 Mjup planet in the disk of JS Pictoris 
(^ 12 Myr) with an orbital radius of 8-12 AU from the star 
(|Lagrange et al. 2010; IChauvin et al. 2012b . More recent stud- 
ies at Ks show that j3 Pic b i s located in the inclined part of 
the disk (Lagrange et al. 20 fT), conforting the link between disk 
mor phology and the p resence of a planet dMouillet el al. 19971 
Aug ereau et al. 20QT] ). JS Pic b also confirms that giant planets 
form in a timescale of 10 Myr or less. Interestingly, Pic b and 
maybe also HR8799e could have formed in situ via core accre- 
tion, in contrast with the other, more remote, young companions 
detected with high-contrast imaging. If formed in situ, the latter 
probably formed through gravitational instabilities within a disk, 
or through the fragmentation and collapse of a molecular cloud. 



Send offprint requests to: A.-M. Lagrange 

* Based on observations collected at the European Southern 
Observatory, Chile, ESO; run 085.C-0277A. 



There are many exciting questions regarding disks and plan- 
ets: could different planet formation processes be at work within 
a given disk? Disks and planets are known to exist in binary 
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Table 1. HR 4796 s tellar properties. (l }Van Leeuwen, 2007[ (2) 
IStauffer et al.T995l 



Spectral Type 
V 

B-V 

7T 

Age 



AOV 
5.78 
0.009 

3.74 !0.33 mas (1) 
8!2 Myr (2) 



systems; (how) do massive companions impact on the dynam- 
ical evolution of inner planets and disks? In a recent study, 
[Rodriguez and Zuckerman 201 1 showed that for a binary sys- 
tem to have a disk, it must either be a very wide binary sys- 
tem with disk particles orbiting a single star or a small separa- 
tion binary with a circumbinary disk. Such results can help the 
search for planets if one relates debris disks with planet forma- 
tion. However, another question, already mentioned, is to which 
extent and how can debris disks indicate the presence of already 
formed planets? 

A particularly interesting system in the present context 
is HR4796A, consisting of an early-type (AO), young, close- 
by star (se e Table [D surrounded by d ust, identifie d in the 
early 90's (Jura 1991) and resolved bv iKoerner et al. 1998 and 
|Jayawardhana et al. 1998 at mid-IR from the ground, and at 
near-IR with NICMOS on the HST (ISchneider et al. 1999b as 
well as from the ground, coupling coronagraphy with adap- 
tive optics (| Augereau et al . 1 999\ . The resolved dust shapes as 
a narrow ring, with steep inner and outer edges. The steep- 
ness of the inner edge of the dust ring has been tentatively at- 
tributed to an unseen planet ( [Wyattet al. 1999| ); however, none 
has been detected so far. The disk images -\- SED modeling re- 
quired at least two populations of grains, one, narrow (a few 
tens AU) cold ring, located at ^ 70 AU, and a second one. 



hotter and much closer to the star ( [Augereau et al . 1 999) , al- 
though t he existence of an e xozodiacal dust com ponent is de- 
bated (Li an d Lunine 2003]) . |Wahhaj et al. 2005 ( argued that in 
addition to the dust responsible for the ring-like structure ob- 
served at optical/near IR wavelengths, a wider, low-density com- 
ponent should be present at similar separations to account for the 
thermal IR images. Recently, higher quality (SN/angular resolu- 
tion) data were o btained with STIS (Schnei der et al. 2009) and 
from the ground (IThalmann et al. 2 01 1 ), the latter using perfor- 
mant AO system on a 8 m class telescope, as well as Angular 
Differential Imaging (ADI, see below). With the revised dis- 
tance of HR4796 with respect to earlier results, the ring radius 
is at about 79 AU, and has a width of 13 AU (STIS 0.2-1 jim 
data). Furthermore, these authors show a 1.2-1.6 AU physical 
shift of the projected ce nter of the disk wrt th e star position 
along the major axis and IThalmann et al. 201 II moreover mea- 
sures a 0.5 AU shift along the disk minor axis. Finally, and 
very interestingly in the context of planetary system formation, 
HR4796 has also a close-by (7.7 arcsec, i.e. about 560 AU pro- 
jected separation), M-type companion dJura et al. 1993K plus a 
tertiary one, located much further away (13500 AU in projection; 
IKastner et al. 20081) . The closest companion may have played a 
role in the outer trunc ature of the disk, even though, according to 
IThebault et al. 20101 it alone cannot account for the sharp outer 
edge of HR4796 as observed by STIS. 

ADI (Marois et al. 20061) is a technics that has proved to be 
very efficient in reaching very high contrast from the ground on 
point-like objects. It has also been used to image disks around 
HD61005 (the Moth disk, IBuenzli et al. 2010j . HD32297 



(IBoccaletti et aL 20111) , and /3 Pic ( |Lagrange et al. 201 1| ), but it 
should be used with care when observing extended structures, as 
the morphology of these structures may be strongly impacted by 
this method (Milli et al, 2012, in prep). 

We present here new high contrast images of HR4796 ob- 
tained with NaCo on the V LT at L' ban d, both in ADI and Sparse 
Aperture Mode (SAM, jTuthill et al. 2010) aiming at exploring 
the disk around HR4796A, and at searching for possible com- 
panions around HR4796A as well as around HR4796B. SAM 
and ADI are complementary as the first give access to regions in 
the 40-400 mas range from the star, and ADI further than typi- 
cally 300 mas. Pedagogical examples of SAM performances and 
results are reported in .Lacour et al. 201 1. 



2. Data log and Reduction 



2.1. Log of observations 



VLT/NaCo (ILenzen et al. 20031 IRousset et al. 2003b L'-band 
data were obtained on April, 6 and 7th, 2010, in ADI mode and 
with SAM. We used the L27 camera which provides a pixel scale 
of ^ 27 mas/pixel. The log of observations is given in Table [2l 

The precise detector plate scale as well as detector orienta- 
tion were measured on an ^ 1 Ori C field observed during the 
same run, and with HST ( |McCaughrean and Stauffer 1994 (with 
the same set of stars TCC058, 057, 054, 034 and 026). We found 
a platescale of 27.10^0.04 mas per pixel and the North orienta- 
tion offset was measured to be -0.26 ^ 0.09 ° if we do not consider 
a systematics in the North position, or -0.26 ^ 0.3 "otherwise (see 
[ Lagrange et al. 20l T]for a detailed discussion on the absolute un- 
certainty on the detector orientation). 

2.1.1. ADI data 



The principle of ADI imaging is given in lMarois et al. 20061 (see 
also ILafreniere et al. 2007b . Here, a typical ADI sequence con- 
sisted in getting sets of saturated images (datacubes of NDIT im- 
ages) at different positions on the detector, followed and prece- 
dented by a series of un- saturated PSF images recorded with a 
neutral density filter (ND Long). These unsaturated images are 
used to get an estimate of the PSF shape for calibration purposes 
(photometry, shape), and fake planet simulation. On April 5/6, a 
few tests were made with different offsets patterns (star centered 
on either 2 or 4 positions on the detector) so as to test the im- 
pact of HR4796B (which rotates on the detector during the ADI 
observations) on the final image qualit}Q. This is important as 
the field of view (FoV) rotation was fast. On April 6/7, the sat- 
urated images were recorded with two offsets corresponding to 
two opposite quadrants on the detector. Both nights, the atmo- 
spheric conditions were good on average, but variable, and the 
amplitude of field rotation was larger than 80° (see Table [2]). The 
comparison between the PSFs taken prior and after the saturated 
images does not reveal strong variations. 

2.1.2. SAM data 

Sparse aperture masking is obtained on Na Co by insertion of a 
mask in the cold pupil wheel of the camera (ILacour et al. 20111 ). 
The mask acts as a Fizeau interferometer. It forms in the focal 



^ As a consequence, in some offset configurations, HR4796B was 
out of the detector FoV, hence the number of usefull data on HR4796B 
is smaller than that available on HR4796A. 
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Table 2. Log of observations. "Par. range" stands for the parallactic angles at the start and end of observations; "EC mean" for the 
average of the coherent energy and "tO mean" for the average of the coherence time during the observations. 



Date 


UT-start/end 


DIT 


NDIT 


N exp. 


Par. range 


Air Mass range 


EC mean 


tO mean 




(s) 












% 


(ms) 


Apr. 07, 2010 


03:08/03:13 


0.2 (ND Long) 


150 


8 


-48.3 to-47.2 


1.07 


44.9 


3.0 


Apr. 07, 2010 


03:14/04:56 


0.2 


150 


160 


-45.3 to 31.9 


1.07 to 1.05 


41.4 


2.6 


Apr. 07, 2010 


04:57/05:06 


0.2 (ND Long) 


150 


8 


32.6 to 38.3 


1.05 


44.0 


2.8 


Apr. 06, 2010 


03:07/03:12 


0.2 (ND Long) 


150 


8 


-50.5 to -48.4 


1.07 


25.1 


6.4 


Apr. 06, 2010 


03:13/05:05 


0.2 


150 


175 


-47.9 to 35.1 


1.07 to 1.05 


37.9 


4.9 


Apr. 06, 2010 


05:06/05:11 


0.2 (ND Long) 


150 


8 


35.8 to 38.8 


1.05 


45.9 


4.6 


Jun. 07/08, 2011 


00:28/02:00 


0.1 


500 


32 


13/64 


1.03/1.15 




3.2 


Jun. 07/08, 2011 


00:44/02:12 


0.1 (Calibrator) 


500 


32 


19/67 


1.04/1.17 




3.2 



plane of the camera interference fringes which are used to re- 
cover the complex vis ibilities of the astro nomical object. Of the 
four available masks (iTuthill et al. 20 1 OK we used the 7 holes 
mask which gives the highest throughput (16%). It is made of 
L2 meters wide circular apertures (scaled on Ml) positioned in 
a non-redundant fashion over the pupil. Minimum and maximum 
baseline lengths are respectively 1.8 and 6.5 meters. Each mask 
offered by SAM can be used in addition to almost all the spectral 
filters off'ered by Conica. 

The principle of SAM is based on its ability to facilitate the 
deconvolution of phase aberrations. Phase errors are introduced 
by i) atmospheric residuals and ii) instrumental aberrations (also 
called non-common path errors). We used integration times of 
the order of the typical coherence time of the phase errors. It 
permits a partial deconvolution of the remaining atmospheric 
perturbation not corrected by the AO. But most importantly, it 
gives an excellent correction of the slowly changing instrumental 
aberrations. This later point is the important factor which makes 
aperture masking competitive with respect to full aperture AO. 

In practice, L' SAM data on HR4796 were obtained on June 
201 1 . The adopted DIT was 100 ms, equivalent to a few tq in the 
L' band. Each set of observation consists in 8 ditherings of the 
telescope to produce 8 datacubes of 500 frames on 8 diff'erent 
positions on the detector. Each dither moves the star by 6 arc- 
sec in X or in Y on the windowed detector (512 by 512 pixels, 
equivalent to 14 arcsec on sky). After 8 dithers, the telescope is 
off'set to the K giant star HD 110036 for calibration, where the 
very same observation template is repeated. Four star-calibrator 
pairs were obtained totalizing 64 datacubes, requiring a total ob- 
servation time of 2 hours (including overheads). Over this time, 
the object has rotated by 50 degrees (the variation of the paral- 
lactic angle). 

2.2. Data reduction 
2.2.1. ADI data 

Each individual ADI image was bad pixel-corrected and flat- 
fielded as usual. Background subtraction was made for each 
cube using the closest data cubes with the star at a difl'erent ofl'- 
set. Data selection was also made, within each data cube and 
also for each data cube. Recentering of the images was done 
using the ofl'sets measured by Mofl'at fitting of the saturated 
PSF. The data cubes were then stacked (averaged) and then re- 
duced with diff'erent procedures that are described in details in 
Lagrange et al. 2011] and reference there-in: cADI, sADI, rADI 
and LOCI. These procedures diff'er in the way the star halo is 
estimated and subtracted. We recall here the diff'erences between 



these various procedures, as well as new ones developed to limit 
the disk self- subtraction in cADI and/or LOCI: 

- In cADI, the PSF is taken as the mean or median of all indi- 
vidual recentered ADI saturated images. 

- To remove as much as possible the contribution of the disk 
from the PSF in the cADI images, we tested two slightly 
modified cADI reductions. In the first one, we start as usual, 
i.e. build a PSF from the median of all data, subtract this PSF 
to all data and rotate back the obtained residual images to 
align their FoV. The data are then combined (median) to get a 
first image of the disk. Then, to remove the disk contribution 
to the PSF, we rotate the disk image back to the n diff'erent 
FoV orientations corresponding to those of the initial images 
and subtract the median of these rotated disk images to the 
PSF. We obtain thus a PSF corrected (to first order) from the 
disk contribution. This disk-corrected PSF is then subtracted 
to the individual initial images; the individual residuals are 
then rotated back to be aligned and stacked (median) to get 
a new disk image (corresponding to one iteration). This ADI 
procedure is referred to as cADI-disk. In the second one, we 
mask the disk region in each file when used to compute the 
reference0. We will call this method mcADI. This method 
will be described in details in a forthcoming paper (Milli et 
al, 2012, in prep). 

- The rADI procedure (identical to IMarois et al. 20061 ADI) 
selects for each frame a given number of images that were 
recorded at parallactic angles separated by a given value in 
FWHM (the same value in FWHM for each separation), to 
build a PSF to be subtracted from the image considered. 

- In the LOCI approach, for each given image and at each 
given location in the image, we compute "parts" of "PSFs", 
using linear combinations of all available data, with coeffi- 
cients that allow to minimize the residuals in a given portion 
of the image. 

- To limit the impact of the disk self- subtraction on the LOCI 
images, we also modified our LOCI approach, masking the 
disk in each file whenever the disk appears in the optimiza- 
tion zone (see Milli et al, 2012, in prep.). We will call this 
method mLOCI. 



^ In practice, we use a synthetic image (without noise) of the disk as 
described below, and scaled to the observed disk flux, and we define 
the binary mask by ascribing to the pixels in the disk region that are 
above a given threshold (20% of the maximum flux). Then the mask 
is applied to each frame in the cube for the PSF estimation, so that the 
pixels corresponding to the disk regions in each frame are not taken into 
account. 
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The parameters used for the rADI and LOCI procedures are 
the following : 



- LOCI/mLOCI Ar = 1.4 x FWHM below 1.6" and 5.6 
X FWHM beyond (radial extent of the subtraction zones); 
g = 1 or 0.5 (radial to azimuthal width ratio), Na = 300; 
separation criteria 1. x FWHM. 

- rADL separation criteria: 1.5 x FWHM; number of images 
used to compute each "PSF" : 20, Ar = 1.4 x FWHM below 
1.6 arcsec and 5.6 x FWHM beyond (radial extent of the psf 
reconstruction zones) 

For comparison purposes, we also performed a zero-order 
reduction (hereafter referred to as "nADI") which consists in, 
for each image, 1) computing an azimuthal average of the image 
(with the star position as the center of the image); we get then a 
1-D profile, 2) circularizing this 1-D profile to get a 2-D image 
centered on the star position, 3) subtracting the obtained image 
to the initial image to get corrected image. We then derotate and 
stack all the "corrected" images. nADI clearly does not benefit 
from the pupil stabilization and is not to be considered as a real 
ADI reduction procedure, but can help in some cases disentan- 
gling artefacts produced by ADI reductions from real features. 

The data obtained on the 6th and 7th were reduced separately 
and then averaged. As they happened to have similar S/N ratio, 
a simple averaging was made. 



2.2.2. SAM data 

The first step to reduce the SAM data is to clean the frames. This 
can be done in the same way as any classical imaging method in 
the infrared. In practice, we flatfielded the data and subtracted 
the background. The background was estimated by taking the 
median value of the 8 datacubes of a single observation set. 

As any interferometric facility, the observable parameters of 
SAM are fringes. The information lays in the contrast (which, 
once normalized, is called visibility) and the phase. Contrasts 
and phases are obtained by least square fitting of the diff'rac- 
tion pattern. Since the fitting of sinusoidal curves is a linear least 
square problem, a downhill algorithm to find the maximum like- 
lihood was not required. Instead, inversion was done by projec- 
tion of the datacubes on a parameter space defined by each com- 
plex visibility fringes. The matrix used for projection is deter- 
mined by singular value decomposition of a model of the fringes. 
In the end, we checked that it gives exactly the same result as a 
least square minimization algorithm of the kind of conjugate gra- 
dient (but much faster). The fringes are modeled by cosines of 
given frequency multiplied by the PSF of the Airy pattern of a 
single hole. Wavelength bandwith is accounted for by smearing 
the pattern over the filter bandpass. 

As a result, we get a single complex value for each baseline 
and each frame. They are used to compute the bispectrum, which 
is summed over the 8 datacubes which correspond to a single 
acquisition. Then, the closure phases are obtained by taking the 
argument of the bispectrum. One set of closure phase is obtained 
for an observation set which takes around 8 minutes. Over that 
time, the parrallactic angle changes less than 6 degrees, which 
eff'ect is neglected (baselines rotation during an observation set 
is not accounted for). The final step consists in calibrating the 
closure phase of HR4796 by subtracting the corresponding val- 
ues obtained for the red giant (HDl 10036). 



3. Data simulations 

Obviously, ADI aff'ects the resulting disk shape because of disk 
self- subtraction. This eff'ect is expected to be more important as 
the disk inclination with respect to line-of- sight decreases. Also, 
the diff'erent ADI reduction procedures will impact diff'erently 
the disk shape. A general study of the impact of ADI on disk 
reductions will be presented in a forthcoming paper (Milli et al, 
2012, in prep.). In this paper, we concentrate on the HR4796 
case and we monitor this impact using fake disks, as done in 



Lagrange et al. 201 1 



3.1. Assumptions 
To simulate the HR4796 



disk, we assumed, following 
Augereau et al. 1999|a radial midplane number density distribu- 



tion of grains oc ((r/ro)" + (r/ro)" ''"O" • We chose ro = 77.5 
AU, ain =35 t o ensure a very sharp inner edge, and aout = -10, 
as assumed bv lThalmann et al. 201 11 The vertical distribution is 
given by: 

Z(r, z) = e~ 



where the height scale ^ = ^o(^f is 1 AU at 77.5 AU. 
The disk flaring coeflftcient is 13=1 and the coeflftcient y = 2 
ensures a gaussian vertical profile. The disk is inclined by 
76 degrees (a pole-on disk would have an inclination of 
degree), and we assumed an isotropic scattering (g=0), as 
Hinkley et al. 2009| polarimetric measurements indicate a low 
value for g (0.1-0.27). The disk was simulated using the GRaTer 
code ( [Augereau et al. 1999} ILebreton et al. 20 12*). It will be re- 
ferred to as HR4796SD. The ring FWHM thus obtained is 
0.14" (before reduction) under such hypothesis. We also con- 
sidered another disk, with all parameters identical to those 
of HR4796SD, but with aout = -4; this disk (referred to as 
HR4796blowoutSD) is representative of the outer density distri- 
bution that would be observed if the outer brightness distribution 
was dominated by grains expelled by radiation pressure as in the 
case of j3 Pic (Augereau et al. 20QT| ). 

3.2. Simulated disk images 

The flux of the simulated disk is scaled so as to have the same 
number of ADU (at the NE ansae) as in the real disk, once both 
simulated and real data are reduced by cADI. When brighter disk 
are needed, a simple scaling factor is applied. The simulated pro- 
jected disks are then injected in a datacube, at each parallactic 
angle, corresponding to each real data file, and are then con- 
volved either by a theoretical PSF matching the telescope and 
instrument response, or the average of the real PSFs taken prior 
to and after the saturated images. Each image is added to each 
frame of the original data cube, with a 130°or 90°off'set in PA 
with respect to the real disk, so as to minimize the overlap be- 
tween both disks. The datacubes are then processed by nADI, 
CADI, mcADI, LOCI and mLOCI. 



4, Tlie HR4796A disl< 

4.1. Disk images: qualitative view 

Figure [T] shows the images obtained when combining the data 
obtained on the 6th and 7th of April. Images resulting from the 
ADI reductions described above are showed: cADI, cADI-disk, 
mCADI, rADI, LOCI, and mLOCI. We also show for compari- 
son the image resulting from nADI reduction. 
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Fig. 1. HR4796A disk at L' (linear scale). The pixel scale is 
27 mas/pixel. From top to bottom, the same data reduced with 
nADI, cADI, cADI-disk, mcADI, rADI, LOCI, and mLOCI (see 
text). Note that the color codes are identical for all cADI reduc- 
tions reductions on the one hand, and LOCI reductions on the 
other hand, to enable comparisons within a given method, but 
different cuts are used for cADI, rADI and LOCI reductions. 



The disk is clearly detected at "large" separations from the 
star with the nADI reduction, and is, expectedly, lost in the Airy 
rings closer to the star. The parts closer to the star in projection 
are revealed only by the real ADI reductions, and actually, the 
disk is more completely detected than in previously published 
images, in particular the west side is almost continuously de- 
tected. The masking greatly improves the image quality of the 
LOCI image; the impact of mcADI with respect to cADI is, 
expectedly, less important, even though the flux restitution is 
increased. Nevertheless, the dynamical range of our images is 
lower than that of the recently AO published images. This is be- 
cause the present data are obtained at L', with a higher Strehl 
ratio, whereas the previous ones were obtained at shorter wave- 
lengths, with lower Strehl ratio, but with detectors that have 
much lower background levels. 

The ring appears very narrow in our L'-data, barely resolved: 
the FWHM measured on the PSF is 4.1 pixels (0.1 1"), while the 
ring FWHM is ^ 5.7 pixels (0.15") (NE) and resp. 5.0 pixels 
(0.13") (SW) on the cADI data. We wiU however see below that 
the ADI reduction has an impact on the observed width. 

IThalmann et al. 201 L report a relative enhancement of the 
disk brightness in the outer part of the ring, along the semi- 
major axis, that they describe as streamers emerging from the 
ansae of the HR 4796 disk. Our images do not show such strong 



features. To test whether such features could be due to the ADI 
reduction and/or data characteristics, we built cADI and LOCI 
images of a brighO HR4796SD-like disk, inserted into our data 
cube, convolved by a theoretical PSF and, in the case of LOCI, 
reduced with Thalmann et al. LOCI parameters, assuming a 23 
degrees FoV rotation. The input disk images are shown in Fig 121 
as well as the reduced ones. The reduced images clearly sho w 
features similar to those observed by Thalmann et al. 20111 in 
their Figures 1 and 3. We also show in Fig |2] the same simu- 
lations of a similar disk inserted into a data cube matching the 
parallactic angle excursions, but assuming no noise. Note that 
for the LOCI reduction of noiseless data, we took the coeffi- 
cients derived from the previous LOCI reduction (taking noise 
into account); this is necessary to avoid major artefacts when 
using LOCI on noiseless data. The later simulations (no noise) 
highlight the reduction artefacts. Other simulations are provided 
in Milli et al. (2012, in prep.). Hence, we conclude that the fea- 
tures indicated as "streamers" are in fact artefacts due to the 
data characteristics (FoV rotation amplitude, number of data, 
SN) and data reduction. The fact that we do not see them in 
the present data is due to our relatively lower dynamical range, 
and to the larger FoV rotation amplitude. To check this, we in- 
jected a fake disk (HR4796SD), with a flux similar to the ob- 
served one in the actual datacubes (with a 130°off'set in PA to 
avoid an overlap of the disks). We processed the new data cubes 
as described above with cADI, mcADI, LOCI and mLOCI. The 
resulting images are shown in Figure [3j the artefacts are not 
detectable. This is also true when considering a fake disk with 
blowout (HR4796blowoutSD). 

Finally, we note a small distorsion in the SW disk towards 
the inner region of the cADI and LOCI images, at (r,PA) be- 
tween (19 pix, 235°) and (28 pix, 220°). The feature, indi- 
cated by a green arrow in Figure [T] is however close to the 
noise level. If we go back to the individual images taken on 
April, 6th and April, 7th, we see that this feature is barely de- 
tectable on the April 6th eventhough in both cases, there is a 
very faint signal inside the disk ellipse (see Figure |4] for the 
cADI images). Hence, in the present data, this feature could 
be due to noise. However, it seems to be at the same posi- 
tion as that pointed by Thalm ann et al. 20m in their data as 
well as .Schneider et al. 20 09 data as well as, in L'-data ob- 
tained at Keck by C. Marois and B. Mcintosh (priv. com.). In 
Thalman n et al. 20 TT] data, it appears as a loss of flux in the an- 
nulus. In the L' data, we see rather a distorsion in the disk and 
a possible very faint additional signal at the inner edge of the 
disk. However, the ring does not appear as azimuthally smooth 
in the IThalmann et al. 20111 or our data, due to ADI reduction 
and limited SN, so it is not excluded at this stage that this fea- 
ture might be an artefact. Clearly, new data are needed to confirm 
this structure, and if confirmed, to study its shape as a function of 
wavelength. If confirmed, its origin should be addressed. In the 
context of the HR4796 system, an interesting origin to be con- 
sidered is the presence of a planet close to the inner edge of the 
disk. To test the impact of the ADI reduction procedure on a disk 
-h close planet system at L' , we inserted a fake point-like source 
close to our fake disk HR4796SD (rotated by 130° with respect 
to the real disk, convolved by the observed PSF, and inserted in 
the datacube) inner edge, and processed the data as described 
previously. For these simulations, we assumed a disk about 10 
times brighter than the real one. We run several simulations with 



^ we assumed a disk 10 ti mes brighter than the ac tual one so as to take 
into account the better SN of IThalmann et al. 201 II H data, compared to 
the present L' ones. 
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convolved disk 



convolved disk, 




Fig. 2. Left) From top to bottom 1) simulated HR4796SD-like disk (projected, no noise); 2) simulated cADI reduction of this disk 
once inserted into our data cube, and convolved by a theoretical PSF. We assumed a 23 degrees FoV rotation as Thalmann et al 
(201 1). 3) idem with LOCI reduction. Right) Idem without noise. 




Fig. 3. Top: simulated disk (model HR4796SD) inserted into the data: images (linear scale) reduced with cADI, mcADI, LOCI and 
mLOCI, for a rotation angle amplitude of 85 deg similar to that of our data. Bottom: idem for a disk model assuming aout =-4 (model 
HR4796blowoutSD). North is up and East is to the left. The real disk is NE-SW oriented; the simulated one is NW-SE oriented. 
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Fig. 4. Top: cADI image of HR4796 on April, 6th. Bottom: idem 
on April, 7th. 



different values of planet fluxes and distances to the disk. For 
some values of the planet position and flux, we were able to re- 
produce a disk appearent distorsion, especially in the LOCI im- 
ages. A representative example is given in Figure [5j in this case, 
the planet flux would correspond to a 2 MJup mass for a disk 
brightness similar to the HR4796 one. 

4.2. Disk properties 
4.2.1. Disk geometry 

We fitted the observed disk by an ellipse, using the maxi- 
mum regional merit method, as in IBuenzli et al. 20101 and in 
IThalmann et al. 201 II The resulting semi-major axis a, semi- 
minor axis b, disk center position along the semi-major axis 
(xc), and the semi-minor axis (yc), and inclination (defined as 
arccos(b/a)) are provided in Table [S) and the fit is showed in 
Figure [6j These parameters are derived from the selection of the 
best fits, defined as those with parameters within 5% of the best 
fit (best merit coefficient). The uncertainties associated to these 
measurments take into account the dispersion within this 5% 
range, and the other sources of uncertainties that are described 
hereafter. 

To estimate the impact of the PSF convolution and ADI 
process on the ellipse parameters, we used our simulated disk 
HR4796SD (without noise) and fitted the disk with an ellipse 
before and after the PSF convolution and the ADI reduction. For 
(a,b), diff'erences of (-0.03 ;0. 12) pixels were found with cADI, 
and (-0.06; -0.3) pixels with LOCI. For (xc, yc), no significant 
diff'erences were found with cADI and very small with LOCI. 



cADI 


• ""7 " 


< ^ 

1 arcsec ^ 


E < ' 


mcADI 




rADI 




LOCI 




mLOCI 







-1 Q.6 2.2 3.8 5.4 1 



.6 10 12 13 15 



Fig. 5. cADI, mcADI, rADI, LOCI and mLOCI images of simu- 
lations of fake disk -h fake point-like source (indicated by a green 
arrow). 



No significant diff'erence was measured on the inclination with 
cADI while a diff'erence of -0.4°was found with LOCI. Finally, 
no significant diff'erences were found on the PA. We corrected 
the measured values on the disk from these biases. We also in- 
serted a model disk HR4796SD in the data cube (at 90 degrees), 
and processed the data. The diff'erences found between the pa- 
rameters of the injected disk and the ones of the recovered disk 
are compatible with the ones obtained in the case "witout noise". 

Besides, the imperfect knowledge of the PSF center may 
also aff'ect the results. To estimate this impact quantitatively, 
we first estimated the error associated to the PSF center, as in 
|Lagrange et al. 201 1^ The error was found to be [0.,0.27] pixel 
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Fig. 6. Best elliptical fit to the L' cADI data. NE is to the left and 
SW to the right. 



on the X-axis and [-0.06, -fO.04] pixel on the y-axis of the detec- 
tor. It appears that this imperfect knowledge on the PSF center 
does not significantly aff'ect the values of (a,b). It impacts the un- 
certainty of the ellipse center by up to 0.2 pixel along the major 
and minor axis, and the disk PA (0.24 °). The uncertainty on the 
PA measurement is found to be 0.15°in cADI. 

Finally, the PA measurement is also impacted by the uncer- 
tainty on the true North Position (0.3°; see a discussion related 
to this last point in Lagrange et al. 20 iT) . 

Our data show an offset from the star center of ^ 22 mas 
on the cADI images (^ 20 mas on the LOCI data) of the 
center of the fitted ellipse along the major axis, and to the 
South. Given the uncertainty associated to this measurement, 
7 mas, we conclude that the observed off'set is real. This off'- 
set along the ma jor axis is in agreeme nt with previous results of 
[Schneider et"ar2 009 (19!6 mas) and IThalmann et al. 201 T\ on 
their LOCI images (16.9 ^5.1 mas). The latter detected more- 
over an off'set of 15.8^3.6 mas along the minor axis, which was 
not detected by Schn eider et al . 2009 ; the measured off'set on our 
cADI images is about 8 mas ^6 mas; hence very close to the er- 
ror bars, so the present data barely confirm the off'set found by 
iThalmann et al. 201 It 



4.2.2. Brightness distribution 

Figure [7] shows the observed radial surface brightness distribu- 
tions (SBD) for the HR4796A disk at L' along the major axis af- 
ter cADI, and LOCI reductions. The SBD extraction was made 
using a 5 pixel vertical binning. The dynamical range of our data 
is small (factor of 10); it is improved with masking technics, 
thanks to a lesser disk self- subtraction (see also Figure O. Yet, 
the disk being only slightly resolved, we cannot perform mean- 
ingful slope measurements on our data. Indeed, the slope of the 
surface brightness distribution depends on several parameters: 
the PSF, the amplitude of the FoV rotation, the ADI procedure, 
the binning used for the extraction of the SBD, and the separa- 
tion range on which the slopes are measured. In the present case, 
the separation range is too small to allow a proper measurement 
of the slope: we run simulations of the HR4796SD disk without 
noise and checked that indeed, measuring the slopes between the 
maximum flux and the threshold corresponding to the noise on 
the actual data gave slopes very difl'erent (much higher) from the 
slope measured on a larger separation range. 



The ring shape seems nevertheless to indicate a sharp outer 
edge, but we need to check the impact of the ADI reduction pro- 
cedure on the final shape of the disk. Figure[8]illustrates the evo- 
lution of the SBD along the semi-major axis, starting from the 
fake disk HR4796SD, then once the disk is inserted in the real 
data cubes at 130°(see the corresponding images in Figure [3]), 
convolved by the observed PSF, and finally when the datacube 
is reduced with cADI and LOCI. The SBD shape is clearly im- 
pacted. We note that the eff'ect is stronger in the inner region 
that in the outer one. To test whether we can discriminate be- 
tween a steep and a less steep outer profile, we consider the fake 
disks HR4796SD and HR4796blowoutSD inserted in the real 
data cubes at 130°(see the corresponding images in Figure [3]), 
and convolved with the real PSF. The SBD profiles after con- 
volution and reduction along the semi-major axis are given in 
Figure [21 We note that the slight shift between the observed and 
simulated disks SBD is due to an unperfect assumption on the 
ring position, and is not relevent here. The observed SBD pro- 
file appears to be more similar in shape to the ones correspond- 
ing to the HR4796SD case rather than the HR4796blowoutSD 
one. We conclude then that even when taking into account the 
possible biases, the data indicate a very steep outer edge, com- 
patible with a out = -10, as found by IThalmann et al. 201 ll rather 
than a less steep one. We cannot provide precise values to the 
outer NE and SW slopes with the present data, but they are in 
any case diff'erent from the ones measured in the case of the 
other A-type stars such as jS Pictoris (ty p. between -4 and -5 ; 
IGolimowski et al. 2006 1 and HD32997 (iBoccaletti et al. 2011b . 
and that are expected from a disk which outer part is dominated 
by grains blown out by radiation pressure from an A-type star 
(see below). 

4.2.3. Disk width 

Our data indicate a ring width of about 0.154" after cADI re- 
duction for the NE side and 0.136" for the SW side (data binned 
over 5 pixels). With mcADI, these values are only marginally 
changed: 0.147" and 0.135" respectively. However, as seen 
above, the SBD, especially inner to the ring is impacted by the 
PSF convolution, the amplitude of the FoV rotation, the ADI 
procedure, the binning used for the extraction of the SBD, the 
noise level as well as the zero flux level after reduction. We made 
several test with fake disks to estimate the impact of these steps 
on the FWHM. Also, we tested the impact of the evaluation of 
the zero level after reduction. It appears that the disk width is 
mainly afl'ected in the present case by the PSF convolution and 
the zero level. Taking all these parameters into account, we can- 
not conclude that the disk is significantly narrower than the size 
found by Schneider et al. (2009) 0.197", which once corrected 
from the broadening by the STIS PSF became 0.18" (13 AU) at 
shorter wavelengths. 

5. Companions around HR4796A 

5.1. SAM detection limits 

The detection limits from the SAM dataset are derived from a 3D 
X2 map. This map has on each axis the three parameters used to 
model a binary system: the separation, the position angle, and 
the relative flux. This model, fitted on the closure phase, is de- 
tailed in Laco ur et al. 2011, Visibilities are discarded. Fig. [121 is 
showing the detection limits as a function of right ascension and 
declination. It is obtained by plotting the 5 cr isocontour of the 
3D map (the isocontour level is given by a reduced of 25). 
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Table 3. Ellipse parameters of the observed disk: semi-major axis (a, mas), semi-minor axis (b, mas), position of the center of the 
ellipse with respect to the star ((xc, yc), expressed in mas), disk PA (deg), and inclination (i, °). 



measured a (mas) b (mas) xc (mas) yc (mas) PA (deg) i (deg) 
cADI 1077.2M.1 270.5^2.4 22.8 !6.5 7.6!5.7 26.85!0.15 75.28!0.15 

LOCI 1070.2!5.4 266.9!3.0 19.5!6.9 10.8!5.7 26.60!0.32 75.58!0.3 




Fig. 7. Observed SBD for the HR4796A disk at L' along the major axis (after a binning of 5 pixels perpendicular to the major axis): 
cADI and mcADI reductions (left); LOCI and mLOCI reductions (right). We note that the peaks of the SBD on the NE and SW do 
not coincide which is due to the shift of the ellipse center along the major axis. 
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Fig. 9. Left: simulated radial brightness distributions for the HR4796ASD disk (green) and HR4796ASBD disk with blowout (red) 
at L' along the major axis (log scale) once inserted in the data cube and after cADI reduction has been applied. For comparison, 
observed SBD (black). Right: simulated radial brightness distributions for the HR4796ASD disk (green) at L' along the major axis 
(log scale) once inserted in the data cube and after LOCI reduction has been applied. For comparison, observed SBD (black). 



We did not account for the presence of the disk in the model 
fitted. We considered that it did not aff'ect the visibilities (because 
very faint), and did not aff'ect the closure phase (because quasi 
point- symmetric). Nevertheless, it is not impossible that some 
of the structures present in Fig. [12] may be caused by a second 
order eff'ect of the disk on the closure phase. Thus, neglecting 
the influence of the disk means that we are conservative on the 
detection limit map. 

Given these values, and assuming V-L' = for this AO-type 
star, and an age of 8 Myr for the system, we derive the 2D de- 
tection limits expressed in Jupiter masses, using DUSTY mod- 
els (Fig. [121 right). At a separation of about 80 mas (6 AU), 
we exclude the presence of companions with masses larger than 



29 Mjup . At a separation of 150 mas, the limit becomes M = 
40 Mjup (DUSTY). In both cases, COND03 models give simi- 
lar limits within 1 MJup. At 60 mas, the detection limit is M = 
50 Mjup (DUSTY) and would be 44 MJup with COND03. Such 
values fall in the mass range of brown dwarfs and represent un- 
precedented mass limits for this range of separations. 

5.2. ADI detection limits 

We computed the detection limits using the data obtained on 
April 6th and 7th, with difl'erent reduction methods. To estimate 
them, we took into account the flux losses due to the ADI re- 
ductions, either injecting fake planets in cubes of empty frames 
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Fig. 10. Left: 2D map of 5-cr detection limit of point-like structures towards HR4796A, using SAM data. Isocontours for Amag = 
3.5, 4.5, 5.5, and 6.5. Right: detection limits expressed in Jupiter masses using COND03 models; isocontours for masses of 20, 40, 
60, 80 and 100 MJup. In both images. North is up and East to the left. 
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Fig. 8. Top: from left to right: simulated disk, simulated disk af- 
ter convolution, after cADI, and after LOCI reductions. Bottom: 
corresponding SBDs, showing the evolution of the profile after 
diff'erent steps of reduction. See text. 



obtained with similar FoV rotation for the cADI procedure, or 
injecting fake planets in the real data cubes in the case of the 
LOCI procedure. The noise was estimated using a sliding 9 pixel 
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Fig. 11. 5-cr detection limit of point-like structures around 
HR4796A, along the major axis in the NE and SW directions 
using SAM and ADI data. 



wide box along any given PA. We checked the obtained detection 
limits by inserting fake planets with fluxes corresponding to the 
5(T limit at difl'erent separations, and processed again the data, 
and mesured the resulting S/N ratio on the planets. The S/N ra- 
tio were close (or sometimes slightly larger than 5) which shows 
that our limits are properly estimated. The 2D-detection limits 
are shown in Figure [12] for cADI, expressed either in contrasts 
or in masses, using the COND03 models (Barafl'e et al. 2003) 
or BT-settl models (lAUard et al. 201 U and assuming an age of 
8 Myr. Similar (not better) limits were obtained with rADI and 
LOCI. To check the robustness of the detection limits obtained, 
we injected fake planets with fluxes corresponding to the 5cr 
level as well as the fake disks and processed the data cubes as 
before. The resulting images (see Fig. (TS]) revealed the planets 
with at least a 5(T level. 
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Table 4. A few detection limits along the semi-major axis of 
HR4796A (NE side). First lines (top) values are derived from 
SAM data, using DUSTY models (note that COND models 
agree within 1-2 MJup in most cases). The other values (bot- 
tom) are derived from ADI data, using COND03 or BT-SETTLE 
models. 
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Fig. 13. Eake planets inserted at 0.3, 0.5, 0.8, and 1" on both 
sides of the disk, with fluxes corresponding to the 5-cr detection 
levels, and reduced with cADI and LOCI. 



The 1-D limits along the major axis, at a PA of 26 degrees 
(NE side of the disk) are showed in Figure [TT] Similar values are 
obtained in the SW direction. A few values expressed in jovian 
masses are given in Table IH The detection limits are better than 
the SAM ones further than ^ 0.25-0.3", with a value of about 
7.5 Mjup at 0.25-0.3"; they are below 3.5 Mjup for separations in 
the range 0.5-1", and well below further than 1.5". Alltogether, 
these are to our knowledge the best detection limits obtained in 
the close surroundings of HR4796A. 



6. Companions around HR4796B 

HR4796B has the following magnitudes: V = 13.3, H = 8.5, 
K = 8.3. Using the observed contrast between HR4796A and 
HR4796B (2.6 mag) on the present data, we find L'^ 8.4 for 
HR4796B, hence L'abs ^4.1. This value is in agreement with 
the Lyon's group model ( Baraff'e et al. 2003L which, given the 
near-IR colors, predicts an absolute L' magnitude of 3.8. We give 
in FigurJT4l the 2D map of the detection limits (5cr), both in 
terms of contrast magnitudes and Jupiter masses. At 0.3", masses 
as low as 2 Mjup could be detected, and at 0.5", the detection 
limit is below IMjup . 



7. Discussion 

7.1. The inner disk sharp edge 

One of the most remarkable features of the HR4796 disk is cer- 
tainly the off'set of the disk center with respect to the star (also 
observed in the case of HD 14 1569, and Fomalhaut). Two ex- 
planations are 1) the presence of a close, fainter companion (in 
such a case, the disk would be a circumbinary disk and orbit 
around the binary center of mass), and 2) the presence of a com- 
panion close to the disk inner edge on an eccentric orbit that 
induces a forced eccentricity to the disk ring by secular grav- 
itational interaction, an explanation which w as proposed to ex- 
plain the eccentricity of the Fomalhaut disk ^Quillen et al. 2Q06| 
IKalas et al. 20051 IKalas et al. 20081 piiang et al. 2009^ 

We first investigate whether this off'set could be due to the 
presence of a close companion. In such a case, the ellipse cen- 
ter would mark the center of mass of the binary system. Using 
the center of mass definition, it appears that the mass of a body 
necessary to shift the center of mass at the observed position of 
the ellipse center would be much larger than the detection limit 
obtained with SAM between 40 and 400 mas or between 400 
mas and 1 arcsec (ring position) with the ADI data. A compan- 
ion located between 23 and 40 mas would have a mass larger 
or comparable to that of HR4696A; such a scenario must be ex- 
cluded as under such conditions, the photometric center of the 
system would also be shifted. Then, the most plausible explana- 
tion to the off'set is a light eccentric planet close to the inner edge 
of the disk. 

We now try to use the detection limits found in this pa- 
per to constrain the properties of an inner planet that could be 
responsible for the steep inner edge observed with HST/STIS 
data, which, conversely to ADI data, is not impacted by ADI 
reduction eff'ects. Wisdom 1980 showed that in the case of a 
planet and particles on circular orbits, we have the relation ^a/a = 
1 .3.(Mp/Ms)^/^ where Mp and Ms are the planet and star masses, 
a is the orbital radius of the planet and d a the distance between 
the planet and the disk inner edge. Hence if a planet sculpts 
the inner edge, its mass and distance from the inner edge must 
satisfy this relation. Assuming an inner edge located at 77 AU, 
we can derive the mass of the planet necessary to produce this 
sharp edge, as a function of its distance to the edge, and test 
whether such a planet would have been detected or not. This is 
done in FigurefTSl where we show the region, inside the yellow 
ellipse, that, given the present detection limits, have to be ex- 
cluded. Hence the only possible location of the planets respon- 
sible for the inner edge is between the yellow ellipse and the red 
one (which traces the inner edge of the disk). We see that along 
the major axis, only the planets closest to the inner edge (less 
than ^10 AU) remain out of the present detection capabilities. 
Hence if a planet is responsible for the inner edge sculpting and 
is located along or close to the major axis, then it should be a 
low mass planet, and located further than 63 AU, ie within about 
15 AU from the edge. Along the minor axis, due to the projec- 
tion eff'ects, the presence of planets is much less constrained: 
only planets at more than 26 AU from the edge would have been 
detected. 

The previous constrains were obtained assuming the planet 
and the perturbated bodies are both on circular orbits. The ac- 
tual disk eccentricity beeing very small, about 0.02, this assump- 
tion is reasonable. As an exercice, we investigate the impact of a 
higher eccentricity, using the results of 'Mustill and Wyatt 2012 
who revisited this scenario, assuming the perturbating bodies 
were on an eccentric orbit; the relation becomes : ^ a/a = 
1.8.e^/^.(Mp/Ms)^/^. With the same reasonning, and assuming 
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Fig. 12. 2D map of 5-sigma detection limit of point-like structures towards HR4796A, using all available data (CADI). Left: ex- 
pressed in contrasts (isocontours from 7 to 1 1 mag., steps of 1 unit). Right: translated in masses using COND03 models (isocontours 
from 2 to 10 Mjup , steps of 1 Mjup ). 




Fig. 14. 2D map of 5-sigma detection limit of point-like structures around HR4796B (April 6th), expressed in contrast (Left), with 
contour-levels of 8 to 11 mag (step =1 mag); and in Mass (Right), with contour-levels of 1 to 6 MJup (step =1 MJup). 



an eccentricity of 0.1, we provide in FigurefTSl the possible lo- 
cations of a planet responsible for the inner edge, with the same 
color conventions as in the circular case. Again, comparison with 
FigurJT2l shows that if a planet was responsible for the inner 
edge sculpting, and located along or close to the semi-major 
axis, then it would have to be located less than ^ 25 AU from 
the edge of the disk. The location of planets along or close to 
the minor axis would not be significantly constrained. This case, 
even though not adapted to the present case as the disk eccen- 
tricity is very small, illustrates the impact of this parameter on 
the planet detection capabilities. 



7.2. The outer disk sharp edge 

Another striking feature of the system is the very steep 
disk outer edge. Radiation pressure from A-type stars in- 
duces surface brightness distributions in the outer part of 
disks with slopes of -3.5 to -5, depending on the assump- 
tions related t o the production laws of small grains (see 
for instance Lecavelier Des Etangs and Vidal-Madjar, 1996[ 



Thebault and Wu 2008 and ref. there-in). In particular, 
Thebault and Wu 2008 modeled the outer parts of collision 
rings with an initially steep outer edge, following the motion 
of the small grains produced through collisions and submitted 
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Fig. 15. Possible remaining locations of a planet inner to the 
disk that could produce an inner sharp edge at 77 AU given the 
present detections limits (Left: case of a circular orbit; Right: 
case of an elliptical orbit with e=0.1). The possible locations are 
restricted to the region between the yellow curve and the red 
ellipse that mimics the disk itself. North is up, East to the left. 



to radiation pressure and showed that, as already proposed, the 
profile of the resulting SBD in the outer part of the disk followed 



a r 



-3.5 



law. They showed that unless the disks are extremely 
and unrealistically dense, and prevent the small grains from 
escaping, the disks have to be extremely "cold" (with an average 
free eccentricity of < 0.0035) to explain an outer power law of 
r"^ (which was the value adopted at this time for the HR4796 
profile). AO data suggest that the situation could be even more 
radical with an even steeper outer edge than previously thought. 
Also, if confirmed, the fact that we possibly find at 3.8 fim a 
disk width diff'erent from that found in the optical (0.2-lyum) 
with STIS would argue against an extremely dense disk, as, in 
such a case, large bodies and small grains would be in the same 
regions. The cold disk scenario can nonetheless be also prob- 
lematic as, in such a case small grains should be underabundant 
dThebault a nd Wu 2008b and the optical/near-IR fluxes would 
be produced by large particules (typ. sizes 50 jim). We should 
expect then a color index difl'erent from that observed (see 
IDebes et al. 2008 ). The latter rather predict that the scattered 
light flux is dominated by 1 .4 jim dust, which seems difficult to 
explain within the dynamically-cold-disk scenario. 

Could gas be responsible for the observed steep outer edge? 



Takeuchi and Artymowicz 2001 investigated the impact of the 



gas in such debris disks, and showed that even small amount of 
gas, 1- a few Earth masses, could partly balance the effects of 
gravitation, radiation pressure and Poynting-Robertson drag and 
alter the grains dynamics differentially, and lead to grains spatial 
distributions, that, depending on the grain sizes, could be differ- 
ent from those expected in a disk- free gas. Under such processes, 
the gas could be responsible for ring-like structures at distances 
depending on the dust size considered. In their attempt to investi- 
gate disks roughly similar to HR4796 and HD 14 1569, assuming 
1 MEarth gas, they showed that, conversely to large grains which 
occupy the whole gas disk, grains with sizes (^ 10-200 yum) tend 
to concentrate in the outer gas disk, where the gaseous density 
sharply decreases. Hence these grains would form a narrow ring 
which position traces the change in the radial distribution the 
gaseous disk. Under this a priori attractive scenario, grains with 
sizes 1-10 yum would still be blown away. The main problem with 
this hypothesis is that it requires a gas disk with a relatively sharp 
outer edge, and thus an explanation for such an edge. Another is- 
sue is that jTakeuchi and Artymowicz 2001, did not explore the 



SBD profile beyond the main dust ring, so that it remains to be 
see whether slopes in the -10 range are possible. Finally, it is 
worth noting that so far no circumstellar gas has been detected 
either in atomic species through absorption spectroscopy (but 
the system being inclined, the non detection is not a strong con- 
straint) or molecul ar species, either CO (Liseau, 1999| ) or H2 
(N(H2)< 10^^cm"^ lMartin-Zaiedi et al. 20081) . In anv case, such 
a scenario can be tested in the forthcoming years with high an- 
gular resolution observations on a wide range of wavelengths. 

We finally study the possibility that the outer disk is sculpted 
by massive bodies. The first candidate we might think of is 
HR4796B. T hebault et al. 20 lOi investigated the possibility that 
the disk could be sculpted by HR4796B, if orbiting on a rather 
eccentric orbit (e> 0.45) but again showed that, even under such 
conditions the outer profile would not be so steep. This is mainly 
because the companion star is not able to dynamically remove 
small grains from the outer regions at a pace that can compen- 
sate for their steady collisional production in the parent body 
ring. 

An alternative explanation could be the presence of a close, 
unseen outer plane t. We investigate this scenario using the new 
code developed by [Thebault (20 12)] to study perturbed collision- 
ally active debris discs. The code computes the motion of plan- 
etesimals submitted to the gravitational perturbation of a planet; 
and follows the evolution of small dust realeased through colli- 
sions among the planetesimals and submitted to radiation pres- 
sure and Poynting-Robertson effect (note that in the present case, 
radiation pressure largely drives the grains dynamics once pro- 
duced). The configuration we consider is a narrow ring of large 
parent bodies, a birth ring of width ~ 8AU centered on 71 AU. 
The collisional production and destruction rates of small grains 
(those which contribute to the luminosity beyond the main ring) 
in this parent body ring is parameterized by the average verti- 
cal optical depth within the main ring, taken to be r = 5 x 10"^ 
0. The resulting SBD (case face-on) is derived assuming grey 
scattering. It can be directly compared to the curve presented in 
Figure 6 of Schneider et al (2009) paper (de-projected curv^l). 

For the perturbing planet's mass, we consider 3 different val- 
ues: ^Mjup, SMjup and 3Mjup, which are consistent with the 
constraints imposed by our observational non-detection. Note 
that ^Mjup is only marginally possible in a very narrow region 
along the disc's semi-minor axis, but we have to keep in mind 
that the detection limits are derived from masses-brightness re- 
lationships that are debated at young ages. We assume a circu- 
lar orbit for the planet (the most f avourable case fo r cleaning 
out the region beyond the ring, see [Thebault (2012)| ) and place 
it as close as possible to the parent body ring, i.e., so that the 
outer edge of the observed ring (around 75 AU) corresponds to 
the outer limit for orbital stability imposed by planetary pertur- 
bations. This places the planet at a distance to the central star 
comprised between 92 and ~ 99 AU depending on its mass. 

In Figure [161 we show the SBD obtained for such a config- 
uration. Note that, for each planet mass, we are not showing an 
azimutal average but the "best" radial cut, i.e. the one that gives 
the closest m atch to the deproje cted NE side SBD obtained in 
Figure 6 of Schn eider et al. 200 9 As can be clearly seen, the 
^Mjup case provides a good fit to the observed profile: the max- 
imum of the SBD roughly corresponds to the outer edge of the 
parent body disk and is followed by a very sharp brightness de- 
crease, with a slope < -10 between 75 and 95 AU, i.e. between 



^ for more detail on the procedure, see [Thebault (2012)"] 

^ the FWHM of the STIS PSF being quite narrow compared to the 



disk width, its impact is very Hmited. 
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brightnesses of 1 and 0.1, a range corresponding approximately 
to the dynamical range accessible to the available images. This 
is significantly steeper than the one that woul d be expected if no 
planet was present (-3.5 according to The bault and Wu 20081) 
and is fully compatible with the observed sharp luminosity de- 
crease. 

Longwards 95 AU, the flux level is lower (< 0.1 ADU) and 
the SBD is flatter (slope ^ -3.8). We also note a plateau inside the 
parent body ring at a level of ~ 0.2, due to both the inward drift 
of small grains because of the Poynting-Robertson efl'ect and to 
the dynamical injection of particles after close encounters with 
the planet. Of course, not too much significance should be given 
to the SBD obtained inwards of the disc since our simulations 
(focused on the outer regions) do not consider any inner planet 
shaping the inner edge of the disc. Nevertheless, they show that, 
should "something" have truncated the disc at around 67 AU in 
the past, then the eff'ect of one external planet on such a truncated 
disc could lead to an SBD compatible with observations in the 
inner regions. For the SMjup case, the fit of the observed SBD is 
slightly degraded, but mostly in the region beyond 90 AU where 
flux levels are close to the 0.1 threshold. For the 3Mjup case, 
however, the fit gets very poor for almost the whole outer region 
(keeping in mind that we are here showing the best radial cut). 

We conclude that a ^Mjup planet located on a circular orbit at 
~ 25 AU from the main ring provides a satisfying fit (especially 
considering the non-negligeable uncertainties regarding flux val- 
ues far from the main ring) to the observed SBD. According to 
the derived detection limits, such a massive planet would have 
been detected almost everywhere except in a very narrow region 
along the disc's semi-minor axis; however, we remind the un- 
certainties inherent to the models used to link planet masses and 
luminosities as a function of the system's age. In any case, even 
a less massive perturber of e.g. Smjup would still give an accept- 
able fit of the observed luminosity profile. The external planet 
scenario thus seems the most likely one for shaping the outer 
regions of the disc. Of course, these results are still preliminary 
and should be taken with caution. A more thorough numerical 
investigation should be carried out, exploring a much wider pa- 
rameter space for planet masses and orbit, as well as deriving 
other outputs that can be compared to observations, such as 2-D 
synthetic images. Such a large scale numerical study exceeds the 
scope of the present work and will be the purpose of a forthcom- 
ing paper. Note also that the more general issue of how planets 
shape collisionally active debris disks will be thoroughly inves- 
tigated in a forthcoming paper (Thebault, 2012b, in prep.). 

8. Summary and future prospects 

In this paper, we have provided the first high-resolution images 
of the HR4796A disk at L' band. They allow us to see a narrow 
disk at almost all PA. As the technics used. Angular Diff'erential 
Imaging is expected to impact the final disk shape and appeare- 
ance, we have developped simulations to investigate quantita- 
tively the impact of the reduction procedures on the disk pa- 
rameters. We conclude that the information on the inner part of 
the disk is significantly impacted, and that the procedure may in 
some cases (depending on the amplitude of rotation of the field 
of view), produce important artefacts. This is specially true for 
LOCI reduction, while classical ADI aff'ects the data to a lower 
extent. We showed in particular that the streamers detected by 
IThalmann et al. 20m at the outer edge of the disk are probably 
due to such artefacts. 

Using both ADI and SAM data, we have derived unprece- 
dented lower limits to the presence of planets/companions down 



to 25 mas from the star. The present data allowed then to put first 
interesting constrains on the location of the possible planet that 
could produce the inner edge of the disk. We showed that the 
planet responsible for the inner edge must be closer than 15 AU 
from the ring if located along or close to the semi-major axis. 
The forthcoming high dynamics instruments such as SPHERE 
on the VLT and GPI on GEMINI will allow to test this hypothe- 
sis with much more accuracy, and be able to actually detect this 
planet in most cases. 

We have discussed several hypotheses to explain the sharp 
outer edge of the disk: gaseous disk, dynamically cold disk, 
planet on the outer edge. Using detailed simulations, we showed 
that a planet located outside the planetesimal ring could nicely 
reproduce the STIS data. Further simulations will help to better 
constrain the planet and parent bodies characteristics. 

In any case, this work shows how disks characteristics can 
help constraining possible planet properties. A very important 
information can be brought by the dependance of the disk prop- 
erties (ring width, SBD) as a function of wavelength. Resolved 
images in the future will be crucial to further understand this 
system. 
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Fig. 16. Synthetic surface brightness profiles obtained, using Thebault (2012)'s numerical model, for 3 diff'erent masses of a putative 
perturbing outer planet: ^Mjup, SMjup and 3Mjup. For each case, the planet has a circular orbit and is placed as close as possible 
to the main ring of large parent bodies in order to truncate it at about 75 AU without destroying it (see text for more details). The 
observed profile, derived from ^Schneider et al. 2009i is shown for comparison. For each planet mass, we show the radial cut (i.e., 
for one position angle along the disc) that provides the best fit to this observed profile. The horizontal line delineates approximately 
the part (above this line) of the SBD accessible to the observations assuming a dynamical range of 10. 
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